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Finite state machine display for operator guidance 



DESCRIPTION 



Technical Field 

The invention relates to the field of process control . It re- 
lates in particular to a finite state machine based control 
system for a process or an apparatus, in particular for process 
equipment for an industrial process or for an industrial plant. 



Prior Art 

Current industrial control systems for industrial processes and 
plants are in many cases built based on simple analog or binary 
control loop structures, and on sequence control structures for 
more complex tasks. The underlying sequences are defined as a 
fixed sequence of steps, each step enabled when the previous 
step is successfully completed, and a step change condition is 
fulfilled. The sequence is in most cases linear, i.e. running 
from an initial step up to a final step with a few loops and 
branches. In case of an unexpected process disturbance, a nor- 
mal behaviour of a sequencer is to stop and to indicate a fail- 
ure to an operator. The operator then has the possibility to 
manually drive the process or apparatus into a desired status, 
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from where the sequencer continues. The operator is informed 
about the status of the process or the apparatus through alarms 
and event messages, and through sequence displays which indi- 
cate the current and the next step as well as the status of 
step change conditions. 

To solve more complex control problems, control systems that 
are based on a finite state machine rather than a linear se- 
quencer are often used. Fully automatic control of a normal se- 
quence including variant control is possible by means of such 
control systems. From the literature and from software engi- 
neering, the method of finite state machine modelling and de- 
sign is known to solve complex control problems. 

US Patent No. 53 01100 describes a control system which is based 
on a finite state machine. The finite state machine is charac- 
terized by a finite number of states Si (i e { 1 , . . . , n) = : S) ex- 
actly one of which it may reside in, and by a set of allowed 
transitions fci,j from a first state Si to a second state Sj, 
with i,j €= T, where T e: \ i,j e S}, the set of allowed 

transitions, is a subset of all possible pairs i,jf with ±,j e 
S. In other" words, a direct transition from the first state S k 
to the second state Sj is possible only if an allowed transi- 
tion t/d exists. In this context, a subset S'c: S of a set S 
may contain some or all elements of the set S. 

More general definitions of finite state machines allow for a 

number N±,j of allowed transitions t\™? from first states S± to 

second states Sj with m = 1 , . . . , 2^,^ . Finite state machines ac- 
cording to this definition are also a suitable basis for con- 
trol systems . 

The states of the finite state machine are in many cases de- 
signed to mirror apparatus and/or process conditions, modes 
and/or status when designing the control system. Transitions 
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between states will e.g. be triggered by events, as will be ex- 
plained below. However, this need not always be the case. Rela- 
tively complex processes may be controlled by simple finite 
state machines with just a few states and allowed transitions. 

In order to control an apparatus or a process, the control sys- 
tem receives data from the process and/or the apparatus and 
sends instructions to the apparatus. In the case of a process, 
control over the process is executed through processing equip- 
ment, which in this case constitutes the apparatus being con- 
trolled, and to which instructions are sent. A behaviour of the 
control system depends on the state the finite state machine 
resides in. 

The data received by the control system contains information 
about the status of the process and/or the apparatus, e.g. a 
fill level of a tank, a temperature of a liquid inside the 
tank, whether a valve is open or closed, a speed with which a 
pump rotates, an amount of liquid flowing through a tube per 
time unit, etc. The data may thus be in the form of a binary 
value, e.g. representing a valve state, in the form of a digi- 
tal representation of a number, a value, a character or a 
string, in the form of an analogue value, or in any other form 
suitable for representing information regarding the process or 
the apparatus. In general, data will be time dependent, i.e. 
will vary continuously or stepwise with time. 

The instructions sent by the control system dictate an actual 
behaviour of the apparatus or processing equipment . What 
instructions are sent depends primarily on the state in which 
the finite state machine resides. The instructions may have the 
form of output values that remain constant as long as the fi- 
nite state machine remains in a given state. In general, how- 
ever, a sequence of instructions will be output in a given tem- 
poral order with given intervals. Instead of a given order 
and/or given intervals, output of instructions may constitute a 
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reaction to the data received. In particular, this may be the 
case in hybrid control systems in which at least one state con- 
trols the apparatus or processing equipment by means of con- 
tinuous control. Some finite state machine control systems, as 
e.g. described in US Patent No. 5623680, provide for special 
entry actions and exit actions, i.e. sets of instructions par- 
ticular to each state that are executed on entry into the state 
and on leaving the state. 

Data received by the control system will in general originate 
from a number of sensors, which may be part of the apparatus, 
the process equipment, but may be independent from apparatus or 
process, as e.g. a sensor sensing environmental parameters like 
temperature. In general, at least one pre-processor will be in- 
terfaced between each sensor and the control system in order to 
convert raw data produced by the sensor into a format suitable 
to the control system. Such a pre-processor may contain an am- 
plifier, and A/D-converter, or the like. The pre-processor is 
not necessarily a physical entity, it may be integrated with 
either the sensor or the control system. Data may be received 
from other sources, including, but not limited to, an external 
clock or an input device, e.g. a switchboard, a keyboard, a 
mouse, etc. 

A transition into another state will take place if a transition 
condition is fulfilled. Transition conditions are in general 
particular to the state the finite state machine resides in. A 
transition condition may be separated into one or more partial 
conditions with the transition condition being a logical func- 
tion of the partial conditions. For example, if the transition 
condition may be separated into more than one partial condition 
with the logical function being a conjunction of the partial 
functions, the transition condition will be fulfilled only if 
all the partial conditions are fulfilled. In this case, the 
partial conditions are said to be interlocked with one another. 
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A transition will often be initiated by an event in the process 
or apparatus, which in turn will cause the data received by the 
control system to fulfil a state change condition. However, a 
transition may also be initiated by the control system itself, 
without direct triggering through data received as described in 
the last paragraph, or by operator input through an input de- 
vice . 

Instructions sent by the control system will in general have to 
pass a postprocessor, which in turn is interfaced to the appa- 
ratus or the process equipment through a driver. Again, post- 
processor and/or driver may be integrated with either the con- 
trol system or the apparatus/process equipment. 

Failure handling in today's industrial control systems - be 
they based on linear sequencers, finite state machines or con- 
tinuous control - is in general left to the operator. While a 
finite state machine control system as described above permits 
automatic error recovery, such a full automatization is not al- 
ways desirable from an operator's point of view, since error 
recovery may include manual mending of a piece of process 
equipment, i.e. may require human interaction with the appara- 
tus or the process equipment . To solve unexpected problems , 
however, detailed knowledge of the process and/or apparatus and 
the control system is required. In many cases, procedures to 
resolve disturbances are known to a designer of the process or 
apparatus, and are at best available to the operator in the 
form of manuals. In addition, state-of-the-art control systems 
give no indications of disturbances that will occur or are 
likely to occur in future steps. As a consequence, disturbances 
can not be anticipated, nor can they be detected prior to oc- 
currence . 
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Description of the Invention 

It is an objective of the invention to create a finite state 
machine control system for an apparatus and/or a process that 
provides the operator with sufficient information about the ap- 
paratus and/or process and the control system, in particular to 
permit efficient operator interaction in case of unexpected 
process disturbances . 

This objective is achieved by a control system according to 
claim 1. The control system is based on a finite state machine, 
which is defined by a finite number of states and by a set of 
possible or allowed transitions between at least one first 
state and for each first state at least one second state. When 
the control system is in operation, the finite state machine 
resides in exactly one current state at any given time and, ac- 
cording to the invention, the control system produces a graphi- 
cal representation of the finite state machine. The graphical 
representation comprises at least two states and at least one 
allowed transition between said two states. Preferably, the 
graphical representation is in electronic, preferably digital 
form, so that it may be displayed on a graphical output device, 
e.g* a computer screen. The graphical representation serves as 
information for the operator and, as an advantage, conveys a 
clear and concise picture of the apparatus and/or process and 
the operation of the control system. 

In another preferred embodiment of the invention, the graphical 
representation comprises all states and all allowed transi- 
tions, thus providing a complete and comprehensive overview of 
the apparatus and/or process and the operation of the control 
system. 

In a preferred embodiment of the invention, the graphical rep- 
resentation shows states as state symbols and allowed transi- 
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tions as connections between state symbols. A state symbol may 
be an icon, a string, a text box or anything else that may be 
uniquely identified with a corresponding state. A connection 
may preferably be a line, an arrow, or a pointer pointing from 
the first state to the second state corresponding to the al- 
lowed transition represented by the connection. A graphical 
representation of the kind just described is typically used to 
characterize finite state machines in drawings or figures, and 
is thus suggestive and straightforward to understand for an op- 
erator familiar with control systems. 

In a preferred embodiment of the invention, when the control 
system is in operation, the current state in which the finite 
state machine resides is marked in the graphical representa- 
tion, preferably by highlighting or colouring the state symbol 
15 corresponding to the current state. As soon as a state transi- 
tion occurs, the graphical representation is updated accord- 
ingly. This way, the operator is constantly informed about the 
current state in which the finite state machine resides, and 
what second state or states may be entered next . 

20 In a preferred embodiment of the invention, for at least one of 
the allowed transitions from a first state to a second state, 
the probability that said allowed transition will happen at an 
arbitrary point of time in the future is indicated in the 
graphical representation. Probabilities for a transition to 

25 happen at an arbitrary point of time in the future will be re- 
ferred to as total transition probabilities in what follows. 
Preferably, total transition probabilities are indicated for a 
majority of allowed transitions, preferably at least for all 
allowed transitions with the current state as first state. The 

30 indication of probabilities helps the operator to supervise the 
apparatus and/or process, in particular, to check whether the 
apparatus and/or process behaves as desired. As a further ad- 
vantage, if a high total transition probability to an undesired 
state, in particular an error or failure state, is indicated, 
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the operator may try to prevent the corresponding transition by 
appropriate interaction with the apparatus, the process, or the 
control system. 

In another preferred embodiment of the invention, for at least 
5 one of the allowed transitions from a first state to a second 
state, the probability that said allowed transition will happen 
within a given time interval is indicated in the graphical rep- 
resentation for at least one time interval, preferably a plu- 
rality of time intervals. Probabilities for a transition to 

10 happen within a given time interval will be referred to as in- 
terval related transition probabilities in what follows. In ad- 
dition to the advantages of displaying the total transition 
probabilities, the interval related transition probabilities 
give the operator an indication about how long it will take for 

15 an allowed transition to occur. Depending on whether the al- 
lowed transition is desired or not, the operator may then take 
measures to speed up, slow down or prevent the occurrence of 
the allowed transition. 

In general, probabilities, i.e. total transition probabilities 
20 and/or interval based transition probabilities change with 
time. If this is the case, the graphical representation is 
preferably updated regularly, e.g. at fixed time intervals or 
when at least one total probability has changed significantly. 
Probabilities may advantageously be indicated by numbers in the 
25 graphical representation. Probabilities may also be indicated 
by a thickness, colour and/or style of arrows or lines repre- 
senting allowed transitions, etc. 

In another preferred embodiment of the invention, the allowed 
transitions are classified according to the transition condi- 
30 tion. In particular, a transition is classified as a 

• controlled transition, if the corresponding transition 
condition, when separated into partial conditions, con- 
tains only partial conditions that depend on the control 
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system, i.e. the allowed transition may be triggered auto- 
matically by the control system itself , 

• operator facilitated transition, if the corresponding 
transition condition, when separated into partial condi- 
tions, contains at least one partial condition referring 
to an operator input, i.e. an operator command or interac- 
tion is required for the transition to occur, 

• process driven transition, if the transition is neither a 
controlled transition nor an operator triggered transi- 
tion. 

Process driven transitions are caused by an intended or excep- 
tional behavior of the controlled process and/or apparatus. The 
fact, e.g. that a certain tank fill level which is reached some 
time after a pump is started, is an intended behavior, whereas 
the full tank becoming empty although no drain valve was ever 
opened would be an exceptional behavior. Controlled transi- 
tions, on the other hand, do not directly depend on process or 
apparatus behavior, in particular, do not require data received 
by the control system to fulfill a predefined transition condi- 
tion. 

When in operation, the control system computes transition prob- 
abilities, i.e. either total transition probabilities or inter- 
val based transition probabilities, for controlled transitions 
from the conditions required to be fulfilled for the control 
system to trigger the transition. Preferably, transition prob- 
abilities for all controlled transitions are indicated in the 
graphical representation . 

For operator triggered transitions, the transition probabili- 
ties can not be determined by the control system, since they 
depend on an operator interaction. However, if the correspond- 
ing transition condition contains partial conditions that do 
not refer to an operator input, probabilities of these partial 
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conditions may be computed, which in turn may be used to com- 
pute release probabilities. A release probability is the prob- 
ability that an operator triggered transition may take place, 
i.e. that 7 when the transition condition for the operator trig- 
5 gered transition is separated into partial conditions, all the 
partial conditions which do not refer to operator input are 
fulfilled. In a preferred embodiment of the invention, the re- 
lease probability is computed by the control system for at 
least one operator triggered transition and indicated in the 
10 graphical representation. This has the advantage of indicating 
to the operator which decisions or interactions may be better 
or worse in the given situation. 

Probabilities for process driven transitions can be determined 
from statistical knowledge about the process and/or apparatus. 

15 E.g., a probability that a transition into an erroneous state 
will occur equals the probability that part of the apparatus 
may break. Preferably, information about a condition of the ap- 
paratus, e.g. its age or the time that has elapsed since main- 
tenance, is taken into account in determining the probabili- 

20 ties. 

In another preferred embodiment of the invention, at least one 
economic parameter is indicated in the graphical representation 
for at least one of the states and/or for at least one of the 
allowed transitions. Preferably, the economic parameter may be 

25 a cost, preferably per unit time, that is caused by the appara- 
tus and/or the process when the control system is in the corre- 
sponding state. However, costs may also be caused by a transi- 
tion, e.g. if a making the transition causes consumption of a 
certain amount or number of material. Alternatively, the eco- 

30 nomic parameter may describe a consumption of lifetime of proc- 
ess equipment, a number of products produced per time unit, 
etc. The economic parameter may be a fixed value pre-programmed 
in the control system, but may also be variable, and favourably 
self -updating, for example in a self -learning system. Indica- 
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tion of economic parameters will convey a clearer picture of 
the economic aspects of running the apparatus and/or the proc- 
ess, and will aid in estimating economic aspects. This is par- 
ticularly helpful in situations where the apparatus and/or the 
process can be influenced by operator interaction. 

In another preferred embodiment of the invention, a short de- 
scription of the transition conditions is given in the graphi- 
cal representation. This way, the operator gets an even better 
overview of the apparatus, the process, and the control system. 

In another preferred embodiment of the invention, a most prob- 
able path is determined by the control system. For determining 
the most probable path, known methods of optimization or linear 
programming can be applied. The most probable path is then 
marked in the graphical representation, favorably by highlight- 
ing the allowed transitions that constitute the most probable 
path. 

In a preferred embodiment of the invention, a number of modes 
exist for the graphical representation. Depending on the mode, 
the graphical representation may comprise only certain subsets 
of all states or transitions; it may contain only a specific 
class of transitions, i.e. controlled, operator facilitated or 
process driven; it may comprise only transitions that have a 
probability of occurrence greater than a given threshold; spe- 
cific subsets of states, e.g. dangerous or error states, and/or 
transitions may be coloured or otherwise highlighted; one or 
more subsets of states may be grouped to simplify the transi- 
tion; etc. Preferably, the operator may switch between the 
modes. Preferably, modes may be defined or modified by the op- 
erator, e.g. by specifying preferences. Preferably, in addition 
to the graphical representation of the finite state machine, 
the control system is capable of producing a normal process 
representation as known to a person skilled in the art of con- 
trol systems, and switching between the normal process repre- 
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sentation and the graphical representation of the finite state 
machine is possible, e.g. through operator interaction. 

In another preferred embodiment of the invention, the control 
system comprises a graphical display device for displaying the 
graphical representation. Preferably, the graphical display de- 
vice comprises means for input of commands by the operator, and 
a graphical user interface permits the operator to select 
graphical representation modes, and/or input commands and/or 
preferences. Favourably, the graphical user interface will pre- 
mit operations like zooming, scrolling, etc. 

Further advantageous realizations can be found in the dependent 
claims . 



Brief Explanation of the Figures 

The invention will be explained in more detail in the following 
text with reference to exemplary realizations and in conjunc- 
tion with the figures, in which: 

Fig. 1 shows an example configuration of process equipment that 
can execute a simple process, 

Fig. 2 shows an example of a finite state machine the control 
system according to the invention may be based on, 

Fig. 3 shows an example of a first mode of a graphical repre- 
sentation of the finite state machine that the control system 
produces when in operation, 

Fig. 4 shows an example of a second mode of the graphical rep- 
resentation of the finite state machine produces when in opera- 
tion 

The reference signs used in the figures are explained in the 
list of reference signs. 
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Approaches to Realization of the Invention 

Fig. 1 shows an example configuration of process equipment 10 
that can execute a simple process. The process equipment 10 
comprises a pump 14 by means of which a fluid can be pumped 
from a reservoir into a tank 12. The tank comprises a first 
fluid sensor 121 and a second fluid sensor 122 for sensing a 
fill level. The tank comprises an outlet 123 with a valve 1231. 
Pump 14, first fluid sensor 121, second fluid sensor 122 and 
valve 1231 are connected to a control system 11 according to 
the invention by means of cable connections 15, which serve to 
transmit data and/or instructions to and/or from the control 
system 11. 

Fig. 2 shows an example of a finite state machine the control 
system according to the invention may be based on. The finite 
state machine comprises six states Si (i=l,...,6) which are de- 
picted as rectangles that are accordingly numbered 1 through 6 
at the top left corner. Allowed transitions t ir j are shown as 
arrows, with i,j e T, where T = {1,2; 2,3; 2,5; 3,4; 4,5; 5,2; 
5,6; 4,1} . While t li2 , t 2 ,s, t 4 , s , and t 5 , 2 are operator facili- 
tated transitions, t 6#1 and t 3 , 4 are controlled transitions and 
^2,3/ t 4 ,i, and t 5f6 process driven transitions. The condition for 
t 2 ,3 to occur is that both the first and the second fluid sen- 
sors 121 and 122 are submerged by the fluid. Similarly, the 
condition for t 4 ,i or fc 5 , 6 to occur is that neither the first nor 
the second fluid sensor 121 and 122 is submerged by the fluid. 
t 4 ,i is an example of an unintended transition that might hap- 
pen, e.g., if a leakage was present in the tank 12. 

Fig. 3 shows an example of a first mode of a graphical repre- 
sentation of the finite state machine that the control sys- 
tem 11 produces when in operation. It is assumed that the fi- 
nite state machine resides in state S 2 , which is indicated by a 
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thick line delimiting the rectangle that corresponds to the 
state S 2 . The probability that the tank 12 will be full and at 
an arbitrary time after the pump 14 has been switched has been 
determined to be 99% from knowledge about the process. Hence, 
the total transition probability for t 2r3 to occur is also 99%, 
which is indicated by a thick arrow with the percentage written 
onto it. 

Fig. 4 shows an example of a second mode of the graphical rep- 
resentation of the finite state machine that the control sys- 
tem 11 produces when in operation, showing only a subset {s 2 , 
S 3 , S 5 } of states and the allowed transitions t± e j between any 
two of the states of the subset. Once more, it is assumed that 
the finite state machine resides in state S 2 , which is indi- 
cated by a thick line delimiting the rectangle that corresponds 
to the state S 2 . Interval based transition probabilities are 
indicated for a number of time intervals. 

The control system 11 according to the invention may be real- 
ized in hardware by a person skilled in the art of electronics. 
Alternatively, a computer that is operationally connected to 
the process equipment may act as control system 11 when appro- 
priate computer program code means are loaded onto said com- 
puter. If the computer comprises graphical display means, in 
particular, a computer screen, the graphical representation as 
shown in Fig. 3 or Fig. 4 is preferably displayed on said com- 
puter screen. 
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List of Referenc Signs 



10 


Process equipment, apparatus and/or process 


11 


Control system 


12 


Tank 


121 


First fluid sensor 


122 


Second fluid sensor 


123 


Outlet 


1231 


Valve 


14 


Pump 


15 


Cable connections 
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PATENT CLAIMS 



1. A control system (11) for controlling an apparatus and/or a 
5 process (10) , 

said control system (11) being based on a finite state ma- 
chine defined by 

• a finite number of states S it i e {l, . . . ,n}= :S, exactly 
one of which said finite state machine may reside in at 

10 any given time, and 

• for at least one first state S*, a number N k ,j of al- 
lowed transitions f£j } to at least one second state S lt 
with k, 1 e T q {i,j | i,j e S}, m = l,...,N kt2 , 

characterized in that 

15 - the control system (11) is configured to produce a graphi- 

cal representation of the finite state machine, comprising 
at least two states S a and with a f Q> e S and a&to, and at 
least one allowed transition t™ m between said two states 
S a and S„. 

20 

2. The control system (11) as claimed in claim 1, characterized 
in that 

the graphical representation comprises all 
states Si, i e S, and all allowed transitions r£j } with 
25 k, 1 e T c {i,j | i,j e S} # m = l,...,Afc,i. 
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3. The control system (11) as claimed in one of the preceding 
claims, characterized in that 

the graphical representation, when displayed on a graphi- 
cal display device, shows states as state symbols and al- 
lowed transitions as connections between state symbols. 

4. The control system (11) as claimed in one of the preceding 
claims, characterized in that 

during an operation of the control system (11) , the cur- 
rent state S k in which the finite state machine resides is 
marked in the graphical representation and 

the graphical representation is updated when a state tran- 
sition has occurred. 

5. The control system (11) as claimed in one of the preceding 
claims, characterized in that 

for at least one of the allowed transitions tff , a transi- 
tion probability is indicated in the graphical representa- 
tion. 

. The control system (11) as claimed in claim 5, characterized 
in that 

the transition probability is a total transition probabil- 
ity . 

. The control system (11) as claimed in claim 6, characterized 
in that 

the transition probability is an interval based transition 
probability. 
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The control system (11) as claimed in one of the claims 5 
through 7, characterized in that 

the allowed transitions are classified as belonging to 
one of the following classes: 

• controlled transition, if a corresponding transition 
condition, when separated into partial conditions, con- 
tains only partial conditions that depend on the con- 
trol system (11) , 

• operator facilitated transition, if the corresponding 
transition condition, when separated into partial con- 
ditions, contains at least one partial condition refer- 
ring to an operator input , 

• process driven transition, if the transition is neither 
a controlled transition nor an operator facilitated 
transition, 

and 

that the control system (11) is configured to compute 
transition probabilities for controlled transitions. 

The control system (11) as claimed in one of the claims 5 
through 8, characterized in that 

a most probable path is determined by the control system 
(11) and marked in the graphical representation. 

The control system (11) as claimed in one of the preceding 
claims, characterized in that 

at least one economic parameter is indicated for at least 
one state Si or one allowed transition iff . 
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11. A computer program product comprising a computer readable 
medium, having thereon: computer program code means that, 
when loaded onto a computer that is operationally connected 
to an apparatus and/or a process, makes said computer con- 
stitute a control system (11) according to one of claims 1 
through 9 . 
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ABSTRACT 

In a control system (11) for controlling an apparatus and/or a 
process (10) , said control system (11) being based on a finite 
5 state machine defined by a finite number of states S± (i e 
{l, . „ . ,n}=:S) , exactly one of which said finite state machine 
may reside in at any given time, and for at least one first 
state Sfc, a number N k/1 of allowed transitions to at least 

one second state S lf with k, 1 e S, m « 1 , . . . , JV*,i/ information 
10 made available to an operator is enhanced by a graphical repre- 
sentation of the finite state machine that the control system 
(11) is configured to produce, and that comprises at least two 
states S and S M and at least one allowed transition between 
said two states S a and S^. 

15 

(Fig. 1) 
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Fig. 2 
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Fig. 3 
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